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Abstract 

The multiscale retinex with color restoration (MSRCR) 
has shown itself to be a very versatile automatic image 
enhancement algorithm that simultaneously provides dy- 
namic range compression, color constancy, and color ren- 
dition. A number of algorithms exist that provide one 
or more of these features, but not all. In this paper we 
compare the performance of the MSRCR with techniques 
that are widely used for image enhancement. Specifically, 
we compare the MSRCR with color adjustment methods 
such as gamma correction and gain/offset application, his- 
togram modification techniques such as histogram equal- 
ization and manual histogram adjustment, and other more 
powerful techniques such as homomorphic filtering and 
‘burning and dodging’. The comparison is carried out by 
testing the suite of image enhancement methods on a set 
of diverse images. We find that though some of these 
techniques work well for some of these images, only the 
MSRCR performs universally well on the test set. 

Introduction 

The Multiscale Retinex 1 (MSR) is a generalization of the 
single-scale retinex 2-4 (SSR), which, in turn, is based upon 
the last version of Land's center/surround retinex 5 . The 
current version of the MSR combines the retinex dynamic 
range compression and color constancy with a color ‘restora- 
tion’ filter that provides excellent color rendition 6-8 . This 
version of the MSR is called the Multiscale Retinex with 
Color Restoration (MSRCR). The MSRCR has been tested 
with a very large suite of images and has consistently proven 
to be better than any conventional image enhancement tech- 
nique. In this paper we present a comparison of the MSRCR 
with several of the most popular image enhancement meth- 
ods. These include point transforms such as automatic 
gain/offset, non-linear gamma correction, non-linear in- 
tensity transforms such as the logarithmic transform or the 
‘square-root’ transform; and global transforms such as his- 
togram equalization 9 , homomorphic filtering 10 , and man- 
ual ‘burning and dodging.’ 


State-of-the-art Techniques 

In this section we briefly describe the characteristics of 
some of the state-of-the-art techniques most commonly used 
for image enhancement. 

Gain/offset correction 

One of the most common methods of enhancing an im- 
age is the application of a gain and an offset to stretch 
the dynamic range of an image. This is a linear operation 
and hence has limited success on scenes that encompass a 
much wider dynamic range than that that can be displayed. 
In this case, loss of detail occurs due to saturation and clip- 
ping as well as due to poor visibility in the darker regions 
of the image. For a scene with dynamic range between 
t'max and t'm.m, and a display medium with dynamic range 
d max , this transform can be represented by 
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where J; is the ith input band, and /' is the ith output band. 
This particular transform will transform the scene to com- 
pletely fill the dynamic range of the display medium. This 
does not imply, however, that this process will provide a 
good visual representation of the original scene. 

Non-linear Point Transforms 

Another well known method used for providing dynamic 
range compression is the application of non-linear trans- 
forms such as the gamma non-linearity, the logarithm func- 
tion, and the power-law function to the original image. 
These functions are typically biased toward increasing the 
‘visibility’ in the ‘dark’ regions by sacrificing the visibil- 
ity in the ‘bright’ areas. The output of such filters can be 
described by 

I'i(x,y) = P[Ii(x,y)\, ( 2 ) 

where P[] represents the point non-linearity. A typical 
point non-linearity is illustrated in Fig. 1. 
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Figure 1: A typical nonlinear point transform function. 


Histogram Equalization 

A global technique that works well for a wide variety of 
images is histogram equalization. This technique is based 
on the idea of remapping the histogram of the scene to a 
histogram that has a near-uniform probability density func- 
tion. This results in reassigning dark regions to brighter 
values and bright regions to darker values. Histogram equal- 
ization works well for scenes that have unimodal or weakly 
bi-modal histograms (i.e. very dark, or very bright), but 
not so well for those images with strongly bi-modal his- 
tograms (i.e. scenes that contain very dark and very bright 
regions). 

Homomorphic Filtering 

The technique that most resembles ours conceptually and 
functionally is homomorphic filtering 10 . The general idea 
of homomorphic filtering is shown in Fig. 2. The image 
is first passed through a logarithmic non-linearity that pro- 
vides dynamic range compression. It is then Fourier trans- 
formed, and its representation in the spatial frequency do- 
main is modified by applying a filter that provides con- 
trast enhancement. The modified image is then inverse 
Fourier transformed and is passes through an exponential 
non-linearity that ‘reverses’ the effects of the logarithmic 
nonlinearity.* Mathematically, 
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* A modified color version of the homomorphic filter was proposed by 
Faugeras^ in 1979. Our implementation simply applies the black and 
white version of the homomorphic filter to each band of the color image 
and combines the results to form a color output image. 


4\x,y) = (6) 
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where T\\, and J r_1 [] represent the Fourier and the in- 

verse Fourier transforms respectively, and ‘H represents 
the homomorphic filter. It is in its final exponential trans- 
form that the homomorphic filter differs the most from the 
MSRCR. MSRCR does not apply a final inverse transform 
to go back to the original domain! 

Manual Image Enhancement 

As both professional and amateur photographers face the 
limitations of the narrow dynamic range in current print- 
ing technology, and the inadequate performance of image 
enhancement algorithms, more and more attention is being 
focused on manual enhancement methods. One such tech- 
nique is ‘burning-and-dodging’ where different regions of 
an image are interactively modified by a user*. The burn 
and dodge tool provides the capability of modifying the 
color content of a region by using tools of varying sizes 
and shapes that work as electronic “scrims.” 

Multiscale Retinex with Color Restora- 
tion 

The general form of the MSRCR can be summarized by 
the following equation: 

s 
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where 'IZm ; is the i\h band of the MSRCR output, S is the 
number of scales being used, w s is the weight of the scale, 
Ij is the i\h band of the input image,, and N is the number 
of bands in the input image. The surround function M s is 
defined by 

M s (x, y) = K exp [a 2 J ( x 2 + y 2 )\ , 

where a s is the standard deviation of the sth surround func- 
tion, and ff Kex p [a 2 / (x 2 + y 2 )] dxdy — 1. The num- 
ber of scales, 5, and the widths of the surround functions, 
<r s , are image independent*. In other words, these have 
been chosen to maximize enhancement for a large-* num- 
ber of images. Once the constants have been selected, then 
the process is truly automatic and independent of the vari- 
ations in scene statistics. 

f Adobe Photoshop 4.0, a commercial photo manipulation software 
package, provides a bum and dodge tool. 

t Typically for 512 X 512 images. The <j & may change with the di- 
mension of images. 

§We have not yet found an exception after having processed 1000+ 
images ! 




Figure 2: Homomorphic filtering^ 


Comparison 

We have compared the MSRCR with all of the image en- 
hancement techniques described above. We present the re- 
sults in Figs. 3, and 4. We present the comparison with 
manual burning and dodging separately. 

Point operations 

Figure 3 shows a collage of images that compares the out- 
put of the MSRCR with the point transforms. As can be 
seen, the MSRCR provided the best overall visual quality 
in each case. The techniques such as histogram equaliza- 
tion perform well for a wide range of scenes, but they also 
fail for a large set. The MSRCR outperforms the other 
methods universally. 

Homomorphic filtering 

Figure 4 shows a comparison of the MSRCR with homo- 
morphic filtering. The homomorphic filter consistently pro- 
vided excellent dynamic range compression but is lacking 
in final color rendition. The output of the homomorphic 
filter in effect appears extremely hazy compared with the 
output of the MSRCR though the dynamic range compres- 
sion of the two methods appears to be comparable. 

Manual Burning and Dodging 

Figure 5 shows a comparison of the MSRCR with the re- 
sults obtained by using manual burning and dodging. The 
manually processed image shows an improvement over the 
original as far as the information and detail in the dark ar- 
eas is concerned but it lacks the vividness and color satu- 
ration that the MSRCR image retains and even enhances. 
There is obvious streaking from the very local operation of 
the tool stroke — this could be eliminated but only at the ex- 
pense of adding considerably to the total processing time. 
In the high detail areas where there are shaip differences 
in reflectance, a tool with size approaching that of a single 
pixel would be required to bring out all the details. Since 
the time needed for enhancing a region is roughly in in- 
verse proportion to the size of the tool being used for the 
processing, this suggests that a very large amount of time 
would be needed to perform such an enhancement. On a 
scene-by-scene basis, the time and effort required for man- 
ual manipulation can be reasonable; but the MSRCR pro- 
duces images that are equivalent or better in quality at a 


fraction of the time. Because the visual quality of man- 
ual burning and dodging is solely limited by the patience 
and time commitment of the user, the case shown is per- 
haps typical of the performance achieved by the persistent 
non-specialist. 


Conclusions 


We have provided a brief description of the most com- 
monly used image enhancement techniques and compared 
their operation with the multiscale retinex with color restora- 
tion. We have shown that the MSRCR outperforms these 
techniques in all cases in terms of dynamic range compres- 
sion achieved, and the rendition of the final color image. 
The automatic nature of the process also enables us to use 
the same set of parameters ‘blindly' for each and every im- 
age that is encountered. Of course, there are a few images 
for which the MSRCR has sub-par performance. But these 
are fairly rare and generally relate to defects in the orig- 
inal image data — such as preferential clipping of a spec- 
tral band. We are currently investigating methods to detect 
such scenes and adaptively adjust the MSRCR to correct 
for these sub-par performances. 
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Figure 3: A comparison of the MSRCR with point operations. Top row: original; second row: histogram equalization: third row: 
gain/offset; fourth row: gamma non-linearity; bottom row: MSRCR 






(a) Original (b) Homomorphic filter (c) MSRCR 

Figure 4: A comparison of the MSRCR with images enhanced by homomorphic filtering. The dynamic range compression achieved by 
the two methods is comparable, but the MSRCR produces images that possess much better contrast and sharper colors. 



(a) Original (b) Manual burning and dodging (c) MSRCR 

Figure 5 : Comparison of the MSRCR with manual ‘buming-and-dodging.’ The manually enhanced image was produced using the 
burning and dodging tool provided in Adobe Photoshop 4.0. Circular tools with soft edges were used to modify the color content of 
different regions. The total time to produce this enhanced image was 20 minutes. The MSRCR image took 45 seconds on a PentiumPro 
200MHz machine. 
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